Positive-Definite 1-Penalized Estimation of Large Covariance Matrices
نویسندگان
چکیده
The thresholding covariance estimator has nice asymptotic properties for estimating sparse large covariance matrices, but it often has negative eigenvalues when used in real data analysis. To fix this drawback of thresholding estimation, we develop a positive-definite 1penalized covariance estimator for estimating sparse large covariance matrices. We derive an efficient alternating direction method to solve the challenging optimization problem and establish its convergence properties. Under weak regularity conditions, nonasymptotic statistical theory is also established for the proposed estimator. The competitive finite-sample performance of our proposal is demonstrated by both simulation and real applications.
منابع مشابه
Positive-Definite l1-Penalized Estimation of Large Covariance Matrices
The thresholding covariance estimator has nice asymptotic properties for estimating sparse large covariance matrices, but it often has negative eigenvalues when used in real data analysis. To fix this drawback of thresholding estimation, we develop a positive-definite l1penalized covariance estimator for estimating sparse large covariance matrices. We derive an efficient alternating direction m...
متن کاملVariable Selection for Joint Mean and Covariance Models via Penalized Likelihood
In this paper, we propose a penalized maximum likelihood method for variable selection in joint mean and covariance models for longitudinal data. Under certain regularity conditions, we establish the consistency and asymptotic normality of the penalized maximum likelihood estimators of parameters in the models. We further show that the proposed estimation method can correctly identify the true ...
متن کاملNonparametric estimation of large covariance matrices of longitudinal data
Estimation of an unstructured covariance matrix is difficult because of its positivedefiniteness constraint. This obstacle is removed by regressing each variable on its predecessors, so that estimation of a covariance matrix is shown to be equivalent to that of estimating a sequence of varying-coefficient and varying-order regression models. Our framework is similar to the use of increasing-ord...
متن کاملA path following algorithm for Sparse Pseudo-Likelihood Inverse Covariance Estimation (SPLICE)
Given n observations of a p-dimensional random vector, the covariance matrix and its inverse (precision matrix) are needed in a wide range of applications. Sample covariance (e.g. its eigenstructure) can misbehave when p is comparable to the sample size n. Regularization is often used to mitigate the problem. In this paper, we proposed an `1 penalized pseudo-likelihood estimate for the inverse ...
متن کاملUnconstrained parametrizations for variance-covariance matrices
The estimation of variance-covariance matrices in situations that involve the optimization of an objective function (e.g. a log-likelihood function) is usually a difficult numerical problem, since the resulting estimates should be positive semi-definite matrices. We can either use constrained optimization, or employ a parameterization that enforces this condition. We describe here five differen...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2013